NON-ORTHOGONAL FUSION FRAMES AND THE 
SPARSITY OF FUSION FRAME OPERATORS 



JAMESON CAHILL, PETER G. CASAZZA, SHIDONG LI 

Abstract. Fusion frames have become a major tool in the implemen- 
tation of distributed systems. The effectiveness of fusion frame appli- 
cations in distributed systems is reflected in the efficiency of the end 
fusion process. This in turn is reflected in the efficiency of the inversion 
of the fusion frame operator 5Vv, which in turn is heavily dependent on 
the sparsity of Sy\>. We will show that sparsity of the fusion frame op- 
erator naturally exists by introducing a notion of non-orthogonal fusion 
frames. We show that for a fusion frame {Wi,Vi}i£i , if dim(Wi) = fc;, 
then the matrix of the non-orthogonal fusion frame operator <Sw has in 
its corresponding location at most ki block matrix. We provide 

necessary and sufficient conditions for which the new fusion frame op- 
erator iSw is diagonal and/or a multiple of an identity. A set of other 
critical questions are also addressed. A scheme of multiple fusion frames 
whose corresponding fusion frame operator becomes an diagonal opera- 
tor is also examined. 



1. Introduction 

Fusion frames were introduced in [9 J (under the name frames of subspaces) 
and [10J, and have quickly turned into an industry (see www.fusionframes.org). 
Recent developments include applications to sensor networks [12] , filter bank 
fusion frames [13] , applications to coding theory [1] , compressed sensing [2 J , 
construction methods [3 HI [TJ (U [5] , sparsity for fusion frames [8] , and frame 
potentials and fusion frames [18]. Until now, most of the work on fusion 
frames has centered on developing their basic properties and on construct- 
ing fusion frames with specific properties. We now know that there are very 
few tight fusion frames without weights. For example, in [7] the authors clas- 
sify all triples (K,L,N) so that there exists a tight fusion frame {Wj}^ 1 
with dim W; L = L, for all i = 1, 2, . . . , K in Hn- 

A major stumbling block for the application of fusion frame theory is 
that in practice, we generally do not get to construct the fusion frame, but 
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instead it is thrust upon us by the application. In a majority of fusion frame 
applications, such as in sensor network data processing, each sensor spans a 
fixed subspace Wj of H generated by the spatial reversal and the translates 
of the sensor's impulse response function [16], [17]. There is no opportunity 
then for subspace transformation, manipulation and/or selection. As a re- 
sult, the fusion frame operator Syy is always non-sparse with an extremely 
high probability. The lack of sparsity of Syy is a significant hinderance in 
computing §jy and its inverse, which is necessary to apply the theory. So the 
central issue in the effective application of fusion frames is to have sparsity 
for the fusion frame operator - preferably for it to be a diagonal operator. 

We have long suspected that there has to be a way to ensure that Syy is no 
more than a block diagonal operator with each block having the dimension 
of the corresponding subspace. It turns out that a notion of non-orthogonal 
fusion frames achieves that and this is the central theme of this paper. 

2. Non-orthogonal fusion frames 

Nonorthogonal fusion frames are a modification of fusion frames [9], |10] 
with a sequence of non-orthogonal projections operators. A non-orthogonal 
projection onto TV is a linear mapping Vw from ~H onto W which satisfies 
V w = Vw- An important property is that the adjoint V w is also a non- 
orthogonal projection from TL. onto J\f(Vw)' L with W 1 - being the null space 
(of V*). Here N(V W ) = {/ G W ■ Vwf = 0}. Also observe that we must 
have that M(V W ) DW = {0}, i.e., M(V W ) @W = U. 

Definition 2.1. Let I be a countable index set. Let {Wi}i^i be a family 
of closed subspaces in %, and let {vi}i^j be a family of positive weighting 
scalers. Denote by V% a non- orthogonal projection onto Wi. Then {Vi,Vi}i<=i 
is a non- orthogonal fusion frame of H = span(J2iei ^i) if there are con- 
stants < C < D < oo such that 

vfen, cimi^^ii^/ii^DH/ii 2 . (l) 

Remarks: (1) Throughout this paper we will use tt for an orthogonal 
projection. It is obvious that if V% is an orthogonal projection 7Tj, then our 
notion of a non-orthogonal fusion frame becomes the standard fusion frame. 
(2) In general, let (^©Wi) P = {{fi}\fi G W, and \\fi\\ G Z 2 (/)}. Define 

the analysis operator Tyv ■ % — > (/ j ®Wi)p by 

Twf = {viPifha, for all fen. 

Then 

The new (non-orthogonal) fusion frame operator 5yy/ : n — > n becomes 
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We compare this to the standard fusion frame operator 



It is also true that the non-orthogonal fusion frame condition (pQ) is equivalent 
to that 



(3) If the standard (orthogonal) fusion frame (OGFF) condition [9], [TO] 
holds, there will be no loss of information with non-orthogonal projection 
operators. Instead, there are infinitely many flexibilities now available which 
is highly beneficial to the sparsity of 5>v as we demonstrate next. 

(4) Oftentimes, subspaces {Wi} are given a priori by applications. Sub- 
space manipulation does not exist nor is allowed in those applications. As 
a result, the fusion frame operator Syy given by the orthogonal projections 
are fixed, and are non-sparse with probability nearly 1. For instance, in M 3 , 
let W\ = {z = 0}, and W2 = {x + y + z = 0} be two planes. Syy by the 
OGFF definition [9], [TO] Syy = + ^2 gives rise to a full matrix with no 
zero entry. 

If on the other hand, if we take V\ = 7Ti, but let V2 be the non-orthogonal 
projection with M(V2) = {z = 0} n {y = 0} so that 



Also, the corresponding non-orthogonal fusion frame operator iSyy has the 
standard matrix representation 



which is now a relatively sparse representation - already much better than 
that of the orthogonal projections. 

Diagonal S\\>: One can achieve more in this example with non-orthogonal 
projections. Say, if we take M(Vi) = span{e2 + 63}. Then Af(Vi) n W\ = 0, 
and 



CId < S w < Did 




then V2V2 is a 2 x 2 block matrix 
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Then 




Consequently, 

/l 0\ 

5 W = V{Vx + V* 2 V 2 = 3 0, 

\ 3 / 

which yields a diagonal non-orthogonal fusion frame operator 5yv- This 
situation is highly beneficial to all fusion frame applications. 

(5) Suppose that fusion frames are used in sensor network applications. 
Each subspace W% represents a sensor. The measurement of each sensor 
is a typical frame expansion {(/, w n )} [T5]. Therefore, not only the sub- 
spaces {Wi} are fixed by the sensors in the network, but also the sensor 
measurements are given a priori. So diagonalizing Syy through subspace 
transformations and/or rotations are not permitted. 

Fortunately, non-orthogonal projections make use of the given sensor mea- 
surement (or the sensory frame expansion) precisely and naturally using the 
notion of pseudoframes for subspaces (PFFS) [15] . In Section [6] we consider 
the implementation of non-orthogonal projections "Pi using PFFS. 

(6) Relating to the notion of nonorthogonal fusion frames, there is the 
notion of g- frames [19], [20]. Actually, g- frames are more general classes 
of "operator frames". Though nonorthogonal fusion frames are a class of 
g-frames with projection operators, the study of this (nonorthogonal) projec- 
tion class has never been carried out, and the restriction to (nonorthogonal) 
projection operators also makes the analysis less flexible than that of the 
general operator frames. Yet, it is this class of projection operators that ac- 
tually find realistic applications in sensor array or distributed system data 
fusion. Because projection operators really have the physical interpretation, 
namely, signals measured by sensors are really projections of the original 
signal/function onto the subspace W spanned by the sensor. Linear mea- 
surements of a signal by sensors and/or linear devices are typically modeled 
by an orthogonal projection operator. Sensors and/or linear devices can also 
function in a nonorthogonal way, the principle of which is discussed in detail 
in Section [6] 

Our work here has also led to a synthesis of positive and self-adjoint 
operator T by projections V%j in the form of J2ij v TPijPij- These ideas will 
be developed in a later article. 



3. Main Problem Statements 

We list here some of the problems needed to be resolved in the topic of 
non-orthogonal fusion frames. In this article, we provide solutions to several 
of these problems. 
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Problem 3.1 (Main Problem). Given subspaces {Wjjig/ of %n which span 
Hn, does there exist a family of non-orthogonal projections {Vi\i^i with Vi 
mapping onto W% so that 

^VtVi = XI? 

iel 

Alternatively, 

V*Vj = D, Da diagonal operator? 

iel 

Conjecture 3.2. We believe that Problem 13.11 has a negative answer with 
strict diagonal right hand sides. But, sparsity to certain degree is always 
achievable. 

Since non-orthogonal projections onto a given subspace are no longer 
unique, the following problem is very natural, and likely to have a positive 
answer. 

Problem 3.3. Given subspaces {Wj}j g / of TIn which span Hn, do there 
exist multiple non-orthogonal projections {Vi}i^i and {Qi}i£i and weights 
{v and {wi}i £ i with Vi, Qi mapping onto Wi so that 

Or perhaps some number of projections - which should not be too large. 

Remark 3.4. Problem 13.31 has a positive answer with v i = 1 for every i £ I 
if the subspaces all have dimension > -y . We show this in Proposition I8.2L 

Since for every subspace W, either W or W 1 - (or alternatively, (J — V)W 
for any projection V onto W) has dimension > y, it would be interesting 
to solve the next problem. 

Problem 3.5. Given subspaces {Wi}i£i, weights {vi}i^i, and projections 
onto the W{ satisfying 

Y jV 2 i v*r i = \i, 

iel 

does there exist projections {Qj}j g / onto {W^-}i e j (or onto {{I —V-^T-Ln} iel) 
and weights {u>j}j g / so that 

iei 

4. Block diagonal characterization of the non-orthogonal 

projection v 

We first show that every subspace W with dim W = k has a projection 
Vw onto it for which the matrix of VZ^Vw is a k x k block matrix. 
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Proposition 4.1. Let W be a k- dimensional subspace ofH-N- Then there 
is a subset K C {1, 2, . . . , N} with \K\ = k and a projection Vw onto W so 
that the matrix ofVw has non-zero entries only on the entries of K x K. 

Proof. Let {e^} be the standard orthonormal basis of Hn- Given an or- 
thonormal basis {xj}f =1 for W, if we row reduce it, we will find a set 
K C {1,2, ...,N} with \K\ = k so that the restriction of the operator 
ttk '■ W — > Vk = span {e,i}i & K is invertible on Vk- Define a mapping 

Vw = (kk\v) 1 kk- 

Then Vw is a projection onto W. Also, Vw e j = if j K implies that for 
j ^ K we have for all i: 

(VwVwei,ej) = (V w ei,V w ej) = (V w ei,0) = 0. 

So the only non-zero entries in the matrix of V w Vw are the entries from 
KxK. " □ 

An alternative argument of the proof goes as follows. Since dim(W) = k, 
one can always find a set A" C {1, 2, . . . , A^} with \K | = N — k such that 
W = span{ej} - eK i complements W, i.e., W C\W = {0} and W+W = %n- 
Now, set the null space of Vw to be M{Vw) = W . Then Vw^j = for 
all j € K . The rest follows by the last 3 lines of the previous proof. Note, 
there are consequently N — k columns of zeros in the matrix of Vw with 
respect to the orthonormal basis {e-,}. 

In fact, more can be said about the sparsity of Vw- 

Proposition 4.2. Let % be Hilbert space with orthonormal basis {ei}f =l . 
Then for every subspace W C %, there exists a projection Vw such that the 
matrix ofVw is triangular with respect to {ei]f =l . 

Proof. Choose K C {1, ...,#}, \K\ = k = dim(W), K = {n, i 2 , . . . , i k ] and 
V = span {eij}j = i, so that the orthogonal projection 7ry onto V is a bijection 
between V and W. We know there exists x\ G W so that i\yx\ = e^. Let 
W\ = {w <E W : (w,x\) = 0} and A\ = {x G W : -Kyw G spanje^ , ej 2 }}. 
Then n W"i is a one dimensional subspace of 1^, so choose x<i in this 
subspace. Repeat inductively so that nyXj £ spanje^ , e^}. Now define 
U : V — > W so that UnyXj = Xj, and define Vw = LJity. Then VyjXj = 
UiryXj = Xj, so V w = Vw- Also, for i G K we have = ^}=i bijiryXj. 
Therefore, for i,£ G K with £ > i we have 

j 

(Vwei,e e ) = ^2bij(iv v xj,e e ) = 0. 
i=i 

Also, if i £ K then Vw(^i) = so for all £, 

(V w ei,e e } = 0. 



□ 
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Remark: Since VyyVw is self adjoint, it is triangular if and only if it is 
diagonal. Consequently, the triangular nature of Vw may only result in 
K x K block diagonal nature in V^Vw- I n Section [5l we will provide a 
characterization of when V^Vw can always be diagonal. 

But first, let us examine an immediate consequence of the non-orthogonal 
fusion frame applied to conventional frames. The evaluation of dual frames 
(to any conventional frames) becomes effortless. There is a corresponding 
Parseval fusion fusion associated with any given conventional frame. 

Example (The case of conventional frames) Let {xi}f£ 1 be a conventional 
finite frame oI%n- The following is immediate. 

Proposition 4.3. Let {xi}fL± is a frame for Hn and let W% = sp{xi}. Then 
there exists projections Vi onto Wi and weights V{ so that Y2i=i vf^fPi = I ■ 

Proof. By Theorem 3.1 there exist projections Vi so that the matrix of 
V*Vi will have only one nonzero entry rj, and this entry will be on the 
diagonal. Let j'j denote the position of rt in the matrix of V*Vi- Now for 
each k = 1,...,N let = {i : ji = k} and let vf = (J2iei r i) f° r each 
i € J*.. □ 



More specifically, let us also make this statement constructively. Write 
■•'i = Assume that the index enumeration of the first iV column 



'r- 



vectors {x{\ is such that 



Vx 



j j 



> for all 1 < j < N. For better stability, 



we may also assume that the enumeration of the first iV vectors is such 



that, for a given j, < 
permutations (such that 



is the largest possible among all possible index 
> for all 1 < j < N). 
Let {e{\ be the standard ONB of %n- F° r 1 < i < N, select Vi such that 



\x 



jj 



M(Vi) = M{et 



(2) 



Write Xj = — . Then 



Vi 



I o 





V 



1 









q xm Q 



\ 





o J 



I < i < N. 



(3) 



That is, the only nonzero vector x^ in Vi is at the i column. This is 
because (Vi&i)i = 1 and Viei = axi. One can verify easily that such a Vi is 
a projection. As a result, for 1 < i < N, 

(p*Vi. '" 



0, 



m = n = i 
otherwise. 
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For N + 1 < i < M, let ji E {1, • • • , N} be such that \x iji \ > \xij\ > for 
all 1 < j < N (assuming none of the vectors of {xi} is a zero vector). Then, 
define 

Af(V i )=Af(e ji ), (4) 

X ' 

and write x; L = . Then V% has the same expression as in ([3]) with all zero 

Xiji 

columns but x% at the jj h column. Therefore, for N + 1 < i < M, 

(■T>*'T> \ / II*"* II ' ^ = ^ = 3i 

V i Hmn ~ \ 0, otherwise. 

Evidently, the choice of M{Vi) = M{e^) (N + 1 < i < M) will have some 
{ej}jL^ selected more than one time (together with the selection process for 
1 < % < N). Let 1 < k < N. Define the index set = {i : ji = k} for all 
N + 1 < i < M. We may now choose the value of the weights Vi by, as an 
alternative to that seen in the proof of Proposition 14. 3} 

„ 2 _ J (|*| + W ' 1 - l ~ N (5 ) 



^ + l<i<M, ^ €{!,■■■ ,N} 



Then the new fusion frame operator 

i 

With such selections of non-orthogonal projections Vi and the associated 
weights Vi, we have constructed a (non-orthogonal) Parseval fusion frame 
{Vi,vf}, where vf are as given in ([5]). 

The frame expansion via the Parseval fusion frame. Let us now 

check what the corresponding frame expansion looks like in the previous 
example. For this, we need to figure out the expression of Vi- We will 
use pseudoframes for subspaces (PFFS) [H] as a tool. Recall that PFFS is 
a frame-like expansion for a subspace W. Specifically, let W be a closed 
subspace of H. Let {x n } C % and {x n } C H be two Bessel sequences (not 
necessarily in W). We say {x n } and {x n } form a pair of PFFS for W if 

/ = y~l(/, x n )x n for every / € W (6) 

n 

One important feature of PFFS is that ([6]) is the non-orthogonal projec- 
tion V W gp{ Xn }± from % onto W along the direction splxn} 1 - [T4] . 

We also point out that if {w n } and {w n } are conventional frames of W, 
then, for any {z n } C W^, the pseudoframe sequence {x n } is always given 
by [H] , (see the details in Section ED 

Xn — t^n • 

One especially useful implication of this characterization is that the direction 
of the projection sp{x n }~ L can be freely adjusted by choosing {x n } properly, 
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which in turn can be accomplished by selecting an appropriate orthogonal 
sequence {z n } C W^. 

Let us now show how PFFS is applied in this particular example. Let 
{yi} be the corresponding PFFS sequence associated with the choice of V% 
in (|2j) and ([4]) (we will show how {yi} are constructed immediately later). 
Then, for all / £ % we have 

/ = SrfSwf = Y,v1V*Vif 

i 

= £*W((/,i/t>*i) 

i 
i 

= ^2vf\\xi\\ 2 (f,yi)yi (7) 

i 

The determination of the sequence {yi}. Since W% = ~sp{xi}, the canon- 
ical dual frame of X{ in W% is Xj/||xj|| 2 . Hence 

Ui — ii rig ' ^ii 

where Zi S = sp{xj}^Lj. The choice of Z{ must also simultaneously 
satisfy ([2]) or (SJ) (depending on the value range of i). 

That Zi G sp{x«}^Lj suggests Zi = (zik)^ must be in the co-dimension 1 
subspace, 

xnzn + x i2 Zi2 H h x iN z iN = 0. (8) 

Also, ([2]) and (|4|) further requires that Af(Vi) = sp{yi}i=i = M{&i) (for 
1 < i < N) or M{Vi) = sp{yi}i =i = M{e jt ) (for N + 1 < i < M). These 
suggest that, when 1 < i < N, 

y ik = 0, Vk ^ i, (9) 

and when N + 1 < i < M, 

yik = 0, Vk^ji, (10) 

where ji £ {1, • • • , N} is as seen in the previous discussion. Equations ([8]), 
((9j) and (fTUj) give rise to 

r - a, 

z ik = { Xilxh , i = l,--- ,N, 



k = i 



and 



. IU.M2 ) ^ — Ji; 
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We have therefore, 

Vi= fo,--- ,0,— ,(),••■ ,o) , i = l,--. ,iV, 

where — appears in the i th position, and x H stands for Hermitian transpose 
of x. Likewise, 

1 



Vi= 0,---,0, ,0,---,0 , i = N + l,---,M, 

V x iji J 

where appears in the jf 1 position. These are certainly consistent with 

x iji 

the matrix representation of V% as in, e.g., ([3]). 

We see that the PFFS sequence {y^} in this example of Parseval fusion 
frames of 1-dimensional subspaces is really a multiple of the orthonormal 
basis {e{\ with possible repeats of some elements of {e^j's. 

Remark 4.4. (1) Let us now check the frame expansion and reconstruction 
with the given frame {x n }. Bringing back the non-orthogonal Parseval fusion 
frame expansion ([7]), with vf's as given in ([5]), we have for all / £ H, 

f = *Yl,vf\\xi\\ 2 (f,yi)yi 

i 

i \ II II 

= ^2vf(f, Xi ) yi . (ii) 

i 

We see that there is no need to calculate dual frames! With coefficients 
expanded by the frame sequence {x n }, a (pseudo) dual sequence for the re- 
construction is the {yi} constructed above. The only computation is about 
vf and one non-zero reciprocal in each y^. Besides the proper weighting fac- 
tor, this expansion becomes a linear combinations of weighted (and possible 
repeated) orthonormal basis elements {e{\. 

(2) Suppose this is for (sensor) signal measurement applications. It is 
important to point out that the PFFS implementation still makes use of 
the given analysis coefficients {(/, Xj)} (or sensor measurements in practical 
applications). In particular, if / 6 ~sp{x n }, {(/, = {(/, Xi}}. This is 
also a critical point in this non-orthogonal fusion frame - that the non- 
orthogonal projection does not require additional measurements in case the 
signal measured is contained in the sensor subspace. 

(3) In light of ((7j), given any frame {x n }, the frame expansion (llip we 
constructed here is also equivalent to a related Parseval frame expansion 
consisting of weighted and repeated orthonormal basis elements. To see 
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this, we bring back (|7|) and (fTTj) and compute for all / G H, 

f = ^vKfi x i)Vi 

i 

= ^2 v i\\ x i\\ 2 (fiyi)yi 

i 

= ^2(f,Vi\\xi\\yi)vi\\xi\\yi, 

i 

which is a Parseval frame expansion whose elements {ui} are weighted and 
possibly repeated orthonormal basis elements, namely Ui = Vi Xi &i for 

V ' \ \X ' 

1 < i < N and ui = — — — e,-. for N + 1 < i < M. If we bring the choice of 
vf of ([5]) back into the picture, it becomes clear that 



U: 



, 1 g, 1 < i < N 
^\j n \ +l e ni N + l<i<M, ji €{!,-•• ,N}. 



Consequently, the frame expansion (jlip is equivalent to a Parseval frame 
expansion with element Uj's being orthonormal basis elements, repeated and 
thereby correctly scaled. 

Note that there are many different such Parseval frames {ui}, with dif- 
ferent repetition factors, judging from the derivation process. 

5. Diagonal characterization of Vy^Vw 

In a simplified version of Problem 13.11 we consider in this section the 
conditions for which one individual V^V-w can be diagonal. 

Proposition 5.1. Fix an orthonormal basis {ei}f =1 for %. Let W C T-L be 

a k— dimensional subspace. The following are equivalent: 

(i) There exists a projection Vw such that the matrix of V^yVw is di- 
agonal with respect to {e{\f =l . 

(ii) There exists a subset K C {1,2, N} , \K\ = k such that there 
exists an orthogonal basis {xi}i^x for W such that Xj(j') = 5ij for 
i,j e K. 

(iii) There exists a projection Qw such that {Qw^i\i&K is an orthogonal 
basis for W and Qw^i(j) = $ij f or hj £ K. 

(iv) There exists a projection Vw such that {Vw e i}ieK is an orthogonal 
basis for W. 

(v) There exists a subset K C {1, 2, . . . , N}, \K\ = k and there exists an 
orthogonal basis {xi}i^K for W such that n^Xi is an orthonormal 
basis for span {ei}i & K- 

Moreover, in all of the above cases, the diagonal elements of V^Vw are 
||xj|| 2 for cases (ii) and (v); \\Qw^i\\ 2 i n case (ii), and \\VwCi\\ 2 for case 
(iv). 
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Proof. (Hi) => (iv) (i) is clear. 

We first show (i) =>• (ii). We know that (Vw^i, Vw&j) = for i / j, so 
{Vw^i}iL\ is an orthogonal set. But dim(W) = k so there exists a if C 
{1, ...,N} such that Vw&% = for i if and {Vw&i}i^K is an orthogonal 
basis for W. Let V = span{ej}j e x- Observe that for x,y £ V 

(x, y) = if and only if (TVar, 7Vl/> = 0. (12) 



Now write 
to see that 




Vw'Pwei = Vw^yVwe-i + Vw{I ~ ^v)Vw&i- 

But Vw(I — ^v)Vw^i = 0, since Vw^i = for i K. Therefore, since Vw 
is a projection (i.e., Vyy = Vw) we have that 

Vy/ei = Vw^yVwe-i- 

Hence, (fT2j) now implies that {iryVw^i}i€K is an orthogonal basis for V. 
Now observe that Try is a bijection between 1/ and W so we can choose 
{x-i}i£K so that vryXj = ej. 

(ii) (iii). By (ii) we know that there is an orthogonal basis {xi}i G K 
for W with the desired properties, so we just need to show that there is a 
projection Qw such that Qw^% = %i for i € K. Define U : H — > H by 

C/e,= 

We now claim that Qw = Uwy satisfies (Hi). Clearly, Qw^% = so we 
just need to check that Qw is in fact a projection. If j £ K then clearly 
Q w ej = 0. If j G if, then Qf^ej = Qiy^j = UrrxXj = Uej = xj so Qvk is 
a projection. 

(ii) => (u) is obvious. 

(v) => (i): Define, 

7-Vej = iij^K, Vw 7T K(xj) = xj. 

It is immediate that Pvk is a projection. Also, "Piy is an orthogonal operator 
when restricted to span {ejjjgx. Hence, if i,j £ K, i ^ j we have 

{VwVweijej) = (Vwei,V w ej) = 0. 
On the other hand, if j ' ^ K then Vw e j = and so 

(Pw'Pw e ii e 3) = (7Vei,7Vej) = (7Vei,0) = 0. 
So we have (i). 

The "moreover" part of the theorem is obvious from the proofs. □ 

We now check that for large dimensional subspaces W of T~L, there is a 
fundamental restriction for finding a projection Vw onto W so that V^yVw 
is diagonal with respect to {e{\. 
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Proposition 5.2. Let Ti be an N dimensional Hilbert space and W a k- 
dimensional subspace. If k > y and there is a projection Vw such that the 
matrix of V^/Pw is diagonal with respect to {e{\f =l then there are at least 
2k — n ej 's in W . 

Proof. By proposition 15.11 part (ii) we can find a K C {l,...,iV} such that 
\K\ = k and an orthogonal basis {xi}i & K for W which satisfies Xi(j) = 
5ij for i,j G K. Therefore, we know that (nyXi, iryXj) = for i,j G K 
which means that ((/ — 7iy)xj, (/ — nv)xj) = for i,j £ K (since we know 
(xi,Xj) = 0). Therefore {(I— nv)xi}i£K is an orthogonal set inside an N — k 
dimensional space, which means there is a J C K such that \J\ > 2k — N 
and (I — nv)xj = for every j G J. Then for each j £ J we actually have 
Xj = ej. □ 

6. The implementation of Vw via pseudoframes for subspaces 

Pseudoframes for subspaces (PFFS) [14j are an extension of frames for 
subspaces W where both frame-like sequences {x n } and {x n } are not nec- 
essarily in VV, yet for every / S W 

f = ^ x n )x n . 

n 

Furthermore, the frame-like condition holds for all vectors in W. Namely, 
there are constants < A < B < oo such that for all / G W 

A\\f\\ 2 <^\(f^n)\ 2 <B\\f\\ 2 . 

n 

Bringing in a projection operator V onto W, and a PFFS gives rise to 

Vg = J2( p 9,Xn)xn- (13) 

n 

for every g G H. 

6.1. P-consistent PFFS and non-orthogonal projections. We recall 
the property of T-'-consistent PFFS with an assumption that the sequence 
{x n } is Bessel in %. Using the same terminology of Aldroubi and Unser 
[21], we say a PFFS is P-consistent pj if UV = U, where U : U I 2 
is the analysis operator functioning as the measuring device in the form 
Uf = {(f,x n )} for all / G %. The "P-consistent principle is to say that the 
direct measurement of a function / equals the measurement of a projection 
(approximation) Vf of / onto (in) W. This clearly depends on the direc- 
tion of the projection. We also recall that a "P-consistent PFFS expansion 
is precisely a non-orthogonal projection operator, and the direction of the 
projection can be arbitrarily adjusted by steering the ~sp{x n } [H], [15] . 

It is known that a PFFS is a P-consistent PFFS if and only if the direction 
of the projection (or the null space of V) N(V) = sp{x n } ± [15] . and it is al- 
ways achievable. Consequently, one can always have M(V) = spjxn}- 1 , and 
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the range of V*, 1Z(V*) = Af(V) ± = sp{x n }. The resulting non-orthogonal 
projection is given by 

n n 

for every g € H. 

If we denote by Vw,Aftt>) the projection operator with the first index W 
as the range, and the second index Af(V) as the "direction" of the projec- 
tion, then PFFS always produces a projection onto W along the direction 
sp{x n } L , namely P Wj sp{ Xn y- 

From another point of view, if J\f(V) is given, one can always select {x n } so 
that sp{x n } = M^)- 1 , and thereby construct a non-orthogonal projection 
via PFFS. More importantly, the selection of {x n } for a given W is made 
easy by the following proposition. 

Theorem 6.1. [2] Let {x n } be a Bessel sequence with respect to W , and 
let {x n } be a Bessel sequence in %. The following are equivalent: 

(1) {x n ,x n } is a PFFS for W. 

(2) Ifirw is the orthogonal projection ofH onto W, both of the following 
hold: 

(a) {nwXn} is a frame for W with a dual frame {irw^n}- 

(b) For all f £ W we have ^wx n ){I — ^w)x n = 0. 

n 

(3) There is a frame {w n } ofW with a dual frame {w n } C W, a sequence 
{z n } in (I — TT]y)T-L and a sequence {y n } G U({w n }) and a unitary 
operator T : ~sp{y n } —>•(/ — ttw)^ so that 

X n — W n T" Z n 

and 

x n =w n + T(y n ). 
Here IA is defined as follows. If {w n } is a frame for W, then 

U({x n }) = |Bessel{y n } : ^(/,x n )y n = 0, for all / G W^j . 

Therefore, if we construct {x n } so that sp{x n } = A/'('P) ± , it turns out 
the choice of {x n } is fairly easy - adding to a frame {w n } of W orthogonal 
components {z n } C W 1 - so that sp{x n } = Af(V) ± . 

6.2. Sensor measurements were not altered while implementing a 

■p>v via PFFS. Suppose fusion frames are applied in sensor network data 
collection applications. Each sensor is then spanned by a sensory frame 
{w n } given by the elementary transformation (often simple shifts) of the 
spatial reversal of the sensor's impulse response function |16j . 

The measurement of each sensor is thus given by {(/, w n )} a-priori by 
the physics of the sensor. Any post processing/fusion operation would have 
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to make use of such a-priori measurements. Implementation through PFFS 
can achieve that. Recall, for all / € % 

Vwf = ^2(f, X n )x n = ^(f, W n + Z n )x n = ^ ((/> W n) + (/, Zn)) X n . 
n n n 

Consequently, we will just need to add a controlled measurement to the 
sensor's complement subspace via {(/, z n )}. The implementation of any 
non-orthogonal projection V\\> will be achieved together with the a-priori 
sensor measurement {(/, w n )}. In particular, if a signal / is within the 
sensory subspace spanned by ~sp{w n }, then (f,x n ) = {f,w n ). 

Subspace transformation will not do. It is worth mentioning that techniques 
of subspace rotation or transformation with the purpose of diagonalizing 
orthogonal projection operators would not be able to make use of the sensor 
measurements {(/, w n )}. This is because diagonalization of 7Tyv involves a 
unitary operator T such that 

D = T H (x H X^ T, 

where X is the matrix with frame elements {w n } as its columns. 

On the one hand, it seems that a transformation in the form of F = XT, 
which is equivalent to the rotation of the subspace, would have had the 
orthogonal projection ny^ diagonalized. On the other hand, the new frame 
system F = XT would have to "measure" functions / by XT{f). But the 
T(f) part simply does not exist in (at least) sensor network and distributed 
processing applications. 

This is why non-orthogonal fusion frames is a much more natural tool to 
achieve the sparsity of the fusion frame operator. 

6.3. The matrix representation of the (new) fusion frame operator 

<Sw F° r computational needs, we show that the new fusion frame operator 
has a natural matrix representation via PFFS. 

Let {w n } and {w n } be a frame and a dual frame, respectively, of the 
subspace W. Form x n = w n + z n with z n G W 1 - for all n such that sp{x n } = 
Af^)- 1 , and note that {x n } is a Bessel sequence of 7i. Then for every / G % 

V W,sp{x n }^f = ^2(f,Xn)w n . 

n 

Consequently, if X is the matrix with {x n } as columns, and Y is the matrix 
with {w n } as columns, then a natural matrix representation of "PvK,sp{x n } x 
is 

Pw^xn} 1 - = YX H . 
As a result, the fusion frame operator Syy is represented by 

S w = V*V = XY H YX H . 
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7. ElGEN-PROPERTIES OF Vw 

We will compare non-orthogonal projections to orthogonal projections. 
The first result is an alternative construction tool. 

Proposition 7.1. Let W be a k- dimensional subspace ofTiw and Vw be a 
(non- orthogonal) projection onto W . Let: 
(1) {xi}f =l be an orthonormal basis for W . 

((2) {yi]f =k+ i be an orthonormal basis for the N — k-dimensional space 
V=(L-V W )U N . 
Then: 

{ x i-iVj}i=l, j=k+l 

are the eigenvectors ofVw with eigenvalues "1" for Xi and eigenvalues "0" 
foryj. 

In particular, Vw is an orthogonal projection if and only ifV = W 1 - . 
Proof. Since Vw is a projection, we have 

Vw%i — x i m 

i.e. Xi is an eigenvector for Vw with eigenvalue "1" . Also, 

VwVi = 0, 

So yi is an eigenvector for Vw with eigenvalue "0". □ 

The converse of the above proposition is also true. 

Proposition 7.2. Given W,V subspaces ofH^ with W P\V = {0}, and 

dim W = k, and dim V = N — k. 

Choose orthonormal bases {xj}f =1 and {yi}f = k + i for W and V respectively. 
Given x £ T-Ln, there are unique scalars {ai}f =l so that 

k N 

x = ^aiXi + ^2 a iVi- 

i=l i=k+l 

Define 

k 

'Pwix) = ^aiXi. 
i=i 

Then Vw is a projection on %n ( and hence, Vw has eigenvectors {xi, yj}^ j 
and eigenvalues "1" for x^ and "0" foryj). 

Proof. We compute: 

k k 

Vwi'Pwx) = Vw(^2 aiXi ^ = aiXi = ^ >H/ ( X ) (by definition). 
i=i i=i 

□ 
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The above tells us what we can get out of non-orthogonal projections if 
we are projecting along a subset of the basis. To keep the notation simple, 
we will project along span {ei}f =k+1 . But this clearly works exactly the 
same for any K C {1, 2, . . . , N} with \K\ = k. 

Corollary 7.3. In %n, let K = {1, 2, . . . , k}. Choose an orthogonal set of 
vectors {yi}i=i i n (J ~ T^Kftiw = Vk c Hn and for each i = 1, 2, . . . , k let 

1 1 

Xi — 71 I u^-i "b Ti ', \\Ui- 

\\ei + yi\\ \\ei + yi\\ 
(Note that if N — k < k, then 2k — N of the yi will be zero). Let W = span 
{xi} k i=l . Define V W :H N ^W by 

Vwe-i = IK + yi\\xi, if i e K, 

and 

Vwa = 0, if i € K c . 
ThenVw is a (non- orthogonal) projection having eigenvectors {xj}f =1 with 
eigenvalues "1" and eigenvectors {e n }^ =N _ k with eigenvalues "0" for n G 
K c . 

Moreover, V^yVw is a diagonal matrix with eigenvectors {e n }^ =1 and 
eigenvalues "0" for i = k + l,k + 2, ...,N and eigenvalues ||ej + yi\\ 2 = 
l + ll2/i|| 2 for i = 1,2,..., k. 

Finally, if Q is the orthogonal projection of "Hat onto the same span 
W , then Q has eigenvectors {xj}^ =1 with eigenvalues "1" and eigenvectors 
i z i}f=k+i an orthonormal basis for W 1 - with eigenvalues "0" . 

Proof. For X{ <E\V, 

||ei + yj|| ||ei + yj|| 

! rPwei + 



Vi + Vi\ 

= \\ e i + yi\\(u — 7 — n) x i 

Vi +yi\\ 

So Vw is a projection. 

For the moreover part, if j is not in K then 

{Vw'Pwe-^ej) = (V w ei,V w ej) = (Twenty = 0. 
If i ^ j € K then 

(Pw'Pwei^j) = (Vwei,Vwej) 

= (||e, + Vi\\xi, \\ej +yj\\xj) 

= Vi + yi\\\\ e j +yj\\(xi,Xj) = 0. 

And if i = j € K then 

{Vw'Pwe^ei) = \\V w ei\\ 2 = \\ei + yi\\ 2 . 
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The finally part is clear. □ 

Remark: It is worth understanding intuitively why V^yVw has all of its 
non-zero eigenvalues > 1. This is happening because by forcing ourselves to 
project along a set of e'jS, we see that Vw must project a set of vectors of 
the form ei to vectors of the form ei + yi where yi _L e, , and hence 

\\V w ei\\ 2 = ||e;|| 2 + H^ll 2 > ||e;|| 2 = 1. 

Now we can see what diagonal entries we can get when V^yVw is a diag- 
onal matrix. 

Corollary 7.4. Fix 1 < k < N and choose K C {1, 2, . . . , N} with \K\ = k. 

(1) If dim k < y and any numbers {a n } n ^K ar & given with a n > 1, 
there is a subspace Wof%M and a (non- orthogonal) projection Vw onto W 
so that the eigenvectors of V w Vw are { e n}n=i respective eigenvalues 
{a n } n £K an d "0" if n ^ K. That is, V^yVw is a diagonal matrix with 
non-zero diagonal entries {a n } n& K- 

(2) If k > y, there is a K\ C K with \K\\ = N — k and if ' {on}neK\ are- 
given with a n > 1, then there is a subspace W of%N and a (non- orthogonal) 
projection Vw onto W so that V^yVw is a diagonal matrix with diagonal 
entries "0" if n ^ K, diagonal entries "1" if n £ K\K\, and diagonal 
entries a n if n £ K\. 

Proof. (1) Since dim W < y, we have that 

N N 

N = — > dim W. 

2 2 ~ 

Hence, there is an orthogonal set of vectors {y n }neK satisfying: 

(a) y n £ Vk^T-Ln- 

( b ) hnW 2 = a n - 1. 

By Corollary 17.31 there exists a subspace W with 

W = span{- jj- (e„ + y n ) : n £ K}, 

\\&n ~T~ UnW 

and a projection Vw so that V^/Vw has eigenvectors {e n }^ =1 and non-zero 
eigenvalues only for n £ K which are of the form: 

||e„ + y n \\ 2 = \\e n \\ 2 + ||yn|| 2 = 1 + (a n - 1) = a n . 



(2) We just do as in (1) except now, we can only find N — k orthogonal 
vectors y n in Vk c Hn- So we pair these y' n s with TV — k of the e' n s in K and 
put e n £ W for the rest of the n £ K. □ 
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8. Tight and multiple fusion frames 

Nonorthogonal fusion frames bring in some quite unique properties that 
the orthogonal fusion frames do not have. For instance, we can now easily 
construct examples of tight fusion frames for non-orthogonal projections 
which do not exist in orthogonal fusion frames. In fact, we may have quite 
spectacular examples where tight fusion frames can be constructed via one 
(proper) subspace. 

One immediate observation is that we may have multiple non-orthogonal 
projections onto one given subspace, now that (non-orthogonal) projections 
are no longer unique. We show that by applying multiple projections onto 
one and each subspace, tight nonorthogonal fusion frames exist. 

Remark 8.1. First, let us observe that there is an obvious restriction on the 
number of projections we need. That is, if W has dimension k in "Hat, then 
each projection onto W has at most k non-zero eigenvalues (and P^Pw also 
has the same). So if we want Yli=\ T^i^i = then 

L>l£j+1. 

In the next proposition we will see that this works if k divides N. However, 
it can be shown that if k does not divide N then this result fails in general. 



Proposition 8.2. Let W QH be a subspace of dimension k > 1. 

(1) Ifk>f, there are non- orthogonal projections {Vi}f =1 onto W so 
that 

V{Ti + V2V2 = 2L 

(2) If N = kL, there are non- orthogonal projections {Vi}^ =1 onto W so 
that 

L 

J2V*Vi = LI. 

i=l 

(3) If N = kL + M and 1 < M < k, there exists a subspace W of dimen- 
sion k and non- orthogonal projections {Pi}f=i onto W so that J2i=i'Pi'Pi 
has {ei}f =l as eigenvectors with eigenvalues "L+l" for {ei}fj[ M and eigen- 
values "L" for {ei}f =N _ M+l . 

Remark 8.3. The problem with part (3) of the Proposition is that we can't 
move this back to an arbitrary subspace W since we are getting Yliei 'PfPi 
a diagonal operator here and 



Kiel / iei 



is not a diagonal operator. 

Before we prove the proposition, we give some simple examples to show 
how the proof will work. 
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Example 1: There is a subspace W in with dim W =2 and two (non- 
orthogonal) projections Vw and Qw giving a 2-tight fusion frame for H3. 
We also know [7] that there is no tight fusion frame for H3 made from orthog- 
onal projections and two, 2-dimensional subspaces. Moreover, the example 
above is "unique" in that the only way to produce a 2-tight (non-orthogonal) 
fusion frame out of projections P with V*V diagonal is to produce the above 
example up to applying a unitary operator. 

To do this, we consider the 2-dimensional subspace of H3 given by: 

W 1 = span {{1,0,0), {0,±=,±=)}. 

Now, by our Corollary 17.31 if we project onto W along with Vw, then 
V w Vw w iH have eigenvectors {e n }^ =1 with respective eigenvalues {1,2,0} 
and if we project onto the subspace W along e2 with Qw, then Q w Qw has 
eigenvectors {e n }^ =1 with respective eigenvalues {1,0,2}. So 

V* w V w + Q w Qw = 2I. 

This example is unique since if we pick any two subspaces W\ , W2 of H3 with 
dim Wj= 2 and choose any projections Vw 1 ,T > W2, t° get diagonal operators 
Vyy Vwn then each projection must have a unit vector in its span and be 
projecting along another unit vector. Hence, all you can get for eigenvalues 
is {l,ai,0} and {1,0,02} and we know that a\,a2 > 1 and these two sets 
of 3 eigenvalues must be arranged so their respective sums are all the same. 
Checking cases we can easily see that this only happens if the eigenvalues 
are lined up as they are and hence a\ = 02 = 2 and backtracking through 
the Corollary, we get exactly our example back. 

We give one more example which illustrates how the general case will go. 

Example 2: In H2N let 

W = span {ei + e^+i ■ 1 < i < N}. 

Then dim W = N (i.e. half the dimension of the space). We will construct 
two projections Vi,V2 so that 

PfPl + V2V2 = 21. 

To do this let V\ be the projection onto W along {ei, e2, ■ ■ ■ , ejy} and V2 
the projection along {ejy + i, ejy + 2, ■ ■ ■ , e2N}- Then by Corollary 17.31 we have 
V*Vi has eigenvectors {e^}?^ with non-zero eigenvalues 2 for each and on 
{e N+i }f =l for VtVx and { ei }f =l for V^. i.e. V^+V^ = 21. 

For the proof of the Proposition we need a simple lemma. 

Lemma 8.4. Let {Wj}j g / be subspaces of a Hilbert space T~L. Assume there 
exists a unitary operator U on H and projections {Vw^i^i onto the spaces 
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UWi so that Yliei^w^Wi = AI. Then {U*VwiU}i^i is a family of projec- 
tions onto {Wi}i£i satisfying Yliei U*V^.V\ViU = XI. 

Proof. Since U is unitary, U* is a unitary operator taking UWi onto Wi. 
Also, 

U*V Wl U{U*V Wl U) = U*V Wl {UU*V Wl U = U*V W V W U = u*v Wl u. 
That is, U*T J w i U is a projection onto W{. Finally, 

u*v* Wi v Wl u = u* [y^vhVw. I = U*\IU = U*UXI = XI. 

i£l Kiel J 

□ 

Proof of Proposition 18.21 Let dim W = k. We have to look at the three 
cases. 

Case 1: We have k > f . 

By Lemma 18.41 we may assume that our fixed subspace W is 

W = span [{a + ek+i}^ U {ei} k i=N _ k+l ) 

By Corollary 17. 31 if we project with V\ onto W along {e$ : i = 1, 2, . . . , N—k} 
we have that V\V\ has eigenvectors {ej}^ 1 with respective eigenvalues "1" 
for {ei} k i=N _ k+ll "2" for i = 1, 2, . . . , JV - Jfe, and "0" otherwise. Let V 2 be 
the projection along {e^ : % = k + 1, k + 2, . . . , iV}. Then by Corollary 17.31 
"P|"P2 has eigenvectors {ei}f =l with eigenvalues "1" for {ei} k =N _ k+1 , "2" for 
i = k + l,k + 2, ... ,N and "0" otherwise. Hence, 

V\V\ + = 21. 



Remark: It is worthwhile to note an important property of the projections 
we constructed. By Corollary 17.31 we have that 



Piei 

and 

V 2 ei 



if i = k + l,k + 2,...,N 

if «=Lfl,L¥J+i,...,* 

if % = 1,2,... ,N- k 

if z=LfJ,LfJ+i,---^ 



2 J ' L 2 - 

This property carries over to our original subspace W since we can let 

N N 

V = span {ei:i= L— J , Y~\ + 1, . . . , fc}. 

Now we need to see that this works when we use Lemma 18.41 But this is 
really immediate. Our original subspace is now U*W and our projections 
are U*ViU,U*V 2 U, and so 

U*V\UU*V 2 U = U*VtV 2 U. 
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Case 2: We have N = kL. 

By Lemma l8.4[ we may assume that our subspace W is: 

W = span {ei + e k+i + e 2 k+i H &{L-i)k+i i = 1,2, . . . ,k}. 

For j = 1,2,. . . ,L, let i^- = = (j-l)fc + l, (j-l)fc+2, . . . , j/c} and let 
be the projection onto along {ej}j e #c- Then by Corollary 17.31 'Pj'Pj nas 
eigenvectors {ej}^ with eigenvalues "0" for i 6 if? and eigenvalues "L" for 
i £ Kj. Since 

ujLi^ = {l,2,...,iV}, 
and the sets {ifj}^ =1 are disjoint, it follows that 

L 

Y J VtV i = Ll. 

8=1 



Case 3: We have N = kL + M , 1 < M < k. 
We define the subspace W by: 

L L-l 

W = span {J2 e jk+i : i = 1, 2, . . . , M} U { e jfc+i : j = M + 1, Af + 2, . . . , fe} 
_ i=o i=o 

For j = 1, 2, . . . , L, let Kj = {i = (j - l)fc + 1, (j - l)fe + 2, . . . , jk}, and let 
= {N — kL + 1, N — kL + 2, . . . , N}. Then we get the result by projecting 
onto W along the sets {K^} k - =l . 

Concluding Remarks. Non-orthogonal fusion frames are clearly natural 
extensions of orthogonal fusion frames previously introduced [S], |10j . With 
non-orthogonal fusion frames, not only can we always make the (new) fusion 
frame operator Syy sparse, but also sometimes enable 5yy to become diag- 
onal or tight. In sensor network data fusion applications, non-orthogonal 
fusion frames is seen as a flexible tool to resolve the non-sparse nature of 
the orthogonal fusion frames operator since sensor subspaces and their re- 
lationships are given a priori by the sensor physics and the deployment of 
sensors. Sparsity considerations through non-orthogonal fusion frames seems 
to be the only effective approach in such applications. The implementation 
of the non-orthogonal projections through pseudoframes for subspaces are 
also discussed in detail. 

It is also seen that the flexibility of non-orthogonal fusion frames brings 
in rather unique and a broad range of properties to the notion of fusion 
frames. Our on-going subsequent work includes multi-fusion frame construc- 
tions with diagonal or tight 5>v, complete tight fusion frame constructions 
based on one (proper) subspace, classification of positive and self-adjoint 
operators by projections, and non-orthogonal fusion frames analysis for a 
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given set of subspaces (such as in sensor networks) so that Sy\> is either 
diagonal or tight. This last task is an ultimate goal. 
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